Adaptive transfer learning

نویسندگان

چکیده

In transfer learning, we wish to make inference about a target population when have access data both from the distribution itself, and different but related source distribution. We introduce flexible framework for learning in context of binary classification, allowing covariate-dependent relationships between distributions that are not required preserve Bayes decision boundary. Our main contributions derive minimax optimal rates convergence (up poly-logarithmic factors) this problem, show rate can be achieved by an algorithm adapts key aspects unknown relationship, as well smoothness tail parameters our distributional classes. This turns out several regimes, depending on interplay relative sample sizes strength achieves optimality careful, tree-based calibration local nearest-neighbour procedures.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Adaptive Transfer Learning

Transfer learning aims at reusing the knowledge in some source tasks to improve the learning of a target task. Many transfer learning methods assume that the source tasks and the target task be related, even though many tasks are not related in reality. However, when two tasks are unrelated, the knowledge extracted from a source task may not help, and even hurt, the performance of a target task...

متن کامل

Transfer Learning with Adaptive Regularizers

The success of regularized risk minimization approaches to classification with linear models depends crucially on the selection of a regularization term that matches with the learning task at hand. If the necessary domain expertise is rare or hard to formalize, it may be difficult to find a good regularizer. On the other hand, if plenty of related or similar data is available, it is a natural a...

متن کامل

Adaptive Feature Ranking for Unsupervised Transfer Learning

Transfer Learning is concerned with the application of knowledge gained from solving a problem to a different but related problem domain. In this paper, we propose a method and efficient algorithm for ranking and selecting representations from a Restricted Boltzmann Machine trained on a source domain to be transferred onto a target domain. Experiments carried out using the MNIST, ICDAR and TiCC...

متن کامل

Concept Transfer Learning for Adaptive Language Understanding

Semantic transfer is an important problem of the language understanding (LU), which is about how the recognition pattern of a semantic concept benefits other associated concepts. In this paper, we propose a new semantic representation based on combinatory concepts. Semantic slot is represented as a composition of different atomic concepts in different semantic dimensions. Specifically, we propo...

متن کامل

A Transfer Learning Approach for Adaptive Classification in P300 Paradigms

Introduction: The P300 is one of the most widely used brain responses in BCIs today, popularized by none other than the P300 speller itself. However, most systems still require significant subject-specific training to achieve accurate, reliable classification of brain signals. We present an approach to classification that allows for classification with zero subject-specific data and also improv...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Annals of Statistics

سال: 2021

ISSN: ['0090-5364', '2168-8966']

DOI: https://doi.org/10.1214/21-aos2102